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Abstract 

In this paper, we present a hybrid graph-drawing algorithm (GDA) for layouting 
large, naturally-clustered, disconnected graphs. We called it a hybrid algorithm 
because it is an implementation of a series of already known graph-drawing and graph- 
theoretic procedures. We remedy in this hybrid the problematic nature of the current 
force-based GDA which has the inability to scale to large, naturally-clustered, and dis¬ 
connected graphs. These kinds of graph usually model the complex inter-relationships 
among entities in social, biological, natural, and artificial networks. Obviously, the 
hybrid runs longer than the current GDAs. By using two extreme cases of graphs as 
inputs, we present in this paper the derivation of the time complexity of the hybrid 
which we found to be 0(|V| 3 ). 


1. Introduction 

Information that abstractly describes the inter-relation-ships among entities in most com¬ 
plex systems is mathematically represented using graphs. Graphs as tools are an intuitive 
approach for visualizing entities because they make it easier for humans to understand the 
relationships between different entities. Because of this, graph visualizations of entities, as 
well as that of processed data, are used in many types of applications. For example, computer 
science concepts are usually easier to understand with the use of visualization concepts such 
as data flow diagrams, subroutine-call graphs, program nesting trees, object-oriented class 
hierarchies, entity-relationship diagrams, organization charts, circuit schematics, knowledge- 
representation diagrams, logic trees, and networks. Other fields of sciences also use graph 
visualization to represent information like concept lattices, evolutionary trees, molecular 
drawings, and maps and map schematics jl]. 

Because of the utility of graph visualization for viewing data that can be understood by 
the user in a vast number of applications, many techniques were devised for drawing graphs 
efficiently and beautifully. Since the first paper by Knuth in 1963 on drawing flowcharts for 
visualization purposes [11, |2], there are now about 300 existing algorithms on graph drawing 
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itself, some of these have improved the existing ones by utilizing the research advances made 
in topological and geometrical graph theory, graph algorithms, data structures, computa¬ 
tional geometry, visual languages, graphical user interfaces and software visualization jlj. 
However, given the numerous available algorithms, there is no one-size-fits-all graph drawing 
algorithm for any given graph. It is also important to identify the class to which a certain 
graph belongs. This is because several graph-drawing algorithms can only make effective 
visualizations on certain graph classes. Additionally, there are several approaches that exist 
in drawing graphs. Some of these approaches are drawing conventions, aesthetics, constraints 
and efficiency. These approaches include topology-shape-metrics, hierarchical, visibility, aug¬ 
mentation, divide and conquer, and force-directed. 

In the current effort, we developed a hybrid force-directed approach algorithm based on the 
one developed by Kamada and Kawai [3j. Here, we used a clustering algorithm called Markov 
cluster algorithm to cluster the original vertices into sub-graphs. We then used the original 
Kamada-Kawai (KK) force-directed algorithm to draw the vertices in each sub-graph. We 
considered each sub-graph as a big “phantom” vertex and applied the Iterative Kamada- 
Kawai (IKK) algorithm to draw the respective locations of the non-uniform-sized phantom 
vertices. 

In this paper, we analyze the runtime of our hybrid graph drawing algorithm (HGDA). We 
illustrate our derivation by considering input graphs in extreme cases: a fully connected 
graph G a (V a , E a ) and a graph with no edges GbiYbi 0 )- With these input graphs, we found 
out that HGDA has 0(|V| 3 ) runtime complexity. 


2. Review 

Because graph drawings are used primarily to visualize information in a more understandable 
way, there are certain criteria that should be met when doing it. Drawing graphs should 
obviously include the type and properties of the graph to be drawn. This is important 
because several graph drawing algorithms are only designed to efficiently work on certain 
types of graphs. It is also essential to know that there is no optimum drawing for any graph 
because human perception changes from every individual. It should be noted that although 
the product of a graph-drawing algorithm may be subjective, it also has objective criteria 
such as drawing convention, aesthetic and constraints. 

For a graph drawing to be admissible, it has to have some drawing conventions that it 
should follow. Examples of these conventions are having polyline for edges, using planar 
mathematics for layouting, and using grids to locate the vertices. A certain type of convention 
that is often used in graph drawing theories jl) is the straight-line drawing. To objectively 
evaluate the aesthetics of a graph drawing, it specifies graphic properties of drawing that can 
achieve readability at the least. Some common aesthetic evaluation includes minimization 
of the total number of crossings between edges and minimization of the drawing area. These 
two efficiently use the drawing space without sacrificing the readability of the relationship 
between vertices j^0]- Additionally, constraints must also be considered specifically when 
drawing sub-graphs. Creating certain constraints on position and space provides how each 
subgraph should be drawn. Example of a common constraint would have a given vertex be 
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drawn at the center of the drawing area. Another one is to have some of vertices be clustered 
or enclosed within a predefined shape s|- 

Because of these criteria, several approaches in graph drawing were established. One of these 
approaches is through the use of force-directed algorithms (FDA). Due to their flexibility, 
ease of implementation and often-pleasant drawings, FDA are often used and improved |9j. 
Conventionally, FDA use straight-line drawings to draw edges in undirected graphs. FDA 
simulate some “force” that is directed to each vertex. When the minimal energy of the 
whole system is already achieved, the position of the vertices in the graph are said to be 
in its balanced state. To find the balanced state of the graph, FDA incorporate two main 
functions: (1) The force model that simulates the forces acting on each of the vertex; and 
(2) An iterative algorithm to find the local minimal energy configuration [1], 

The KK algorithm takes in a connected graph fy(V, £) and uses the graph theoretic distance 
(GTD) between each pair of vertices u G V and v G V as its force model. GTD between 
vertices u and v is calculated as the number of edges on a shortest path from vertex u 
to vertex v. Usually, the aim of the FDA that uses GTD as a force model is to find the 
Euclidean distance between u and v to be approximately proportional to their GTD. KK 
includes an energy or spring view in the GTD fli- Because of this, KK was able to 
create symmetric drawings with relatively few edge crossings, which is practically similar to 
drawing isomorphic graphs [3j. It should be noted, however, that KK only focused on fairly 
simple graphs. Originally, it was intended to solve undirected, non-weighted, simple and 
fully connected graphs [lOj]. An obvious problem for KK is the its inability to scale to handle 
large graphs. This inability is common also for other FDA. FADE [9|, a fast algorithm 
for two-dimensional drawing of large undirected graphs, was one of the more successful 
implementations of FDA that scale to larger graphs. It uses clustering before applying FDA, 
although primarily to lessen the computational time, and secondarily for maintaining the 
visualization better [9|. 

There are many ways to cluster large graphs into manageable sub-graphs. Examples of 
these are the graph theoretic clustering [11.] and the geometric clustering [12|hprocedures like 
the ones being used in FADE, and the Markov Cluster Algorithm (MCL) |l3j]. One of the 
advantages of MCL is that it does not have any high level procedural rules for splitting or 
joining groups. The idea of MCL is to simulate a system of “current” C flowing inside the 
graph, promote that system when C is strong, or demote the system when C is weak. The 
computational paradigm is that C between natural groups in the graph will wither away, 
revealing the cluster or sub-graph [l3| . 


Clustering a graph into sub-graphs defines the structure and natural clusters within the 
graph. By doing so, it arranges the vertices in the adjacency matrix A by creating blocks 
of “Is” diagonally in A where the clusters are formed. This makes it easy for the FDA to 
find the equilibrium by re-ordering the vertices according to their connections within and 
between the clusters, as opposed to the original procedure of randomly arranging vertices 
in Q 
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3. Theoretical Framework 


3.1. Preliminary 

A graph Q is a pair of sets (V, £). V is the set of vertices and the number of vertices n — |V| 
is the order of the graph. The set £ contains the edges of the graph. In an undirected 
graph, each edge is an unordered pair {u,w}. A vertex w is adjacent to a vertex v if and 
only if ( v,w ) is an element of the set £. In an undirected graph, the abstract relationship 
represented by ( v,w ) is the same as that of (w,v). 

A path in a graph is a sequence of vertices wi, u> 2 , ■ ■ ■, w n such that there exists an edge 
(u)i,Wi + i) where 1 < i < n. The length of the path is equal to number of edges (n — 1), 
where n — |V| is the number of vertices that runs along that selected path. 

A simple path is a path such that all vertices are distinct^ with the exception of the first and 
last vertex of the path, which can be the same vertex [15j ] . 

A graph G'(V', E ') is a sub-graph of Q(V,£) if V' C V and E' C £ fj(H' x V). 

A graph Q(V,£) with n = |V| vertices can be described by an n x n adjacency matrix A 
whose rows and columns correspond to vertices. The matrix elements A UtV = 1 if (u, v) is 
part of £. A UjV = 0 otherwise. A graph is connected if there is a path between u and v for 
each pair of vertices u and v. 


3.2. Clustered and disconnected graphs 


Graphs that are of small-world, scale-free characteristics are naturally clustered with some 
disconnected components. Small-world graphs are characterized by a very small network 
diameter, which usually values within six for naturally-occurring social networks SAf 0 , 0 . 
The degree A* of a vertex v t counts the number of incident edges of v t . A symmetric 
matrix Aij represents an undirected graph Q, where Aij = Aj,i = 1 if is incident to Vj. 
Thus, Aj = YAj=\Ai t j. For most SAf, the frequency distribution p(A) of the degree in Q has 


been found by various researchers [18H201] to asymptotically follow the power law distribution 


of the form p(A) = ax AA For social networks, and all other biological networks, the power 


usually takes the value — 3 < <p < —2. Having p(A) ~ a x /SA makes SAf scale-free 18 


Figure |T] shows an example of a small-world, scale-free graph that is naturally clustered and 
disconnected. 


3.3. Connected components 


The connected components of an undirected graph Q are the maximal disjoint sets 
Vi,V 2 ,... ,V n such that V = V\ U V 2 U • • ■ U V n , and the vertices u,v 6 Vi if and only 

” 0. Two methods are generally used 


if u is reachable from v and v is reachable from u 
to identify the connected components of Q\ (1) The breadth-first-search (BFS); and (2) The 
depth-first-search (DFS). We can use any of these two to see if a certain path from u to v 
exists for each vertex pair of (u,v) [0. Given a starting vertex vq, BFS systematically 
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Figure 1: An example large, naturally-clustered and disconnected graph Q drawn using KK. 

This graph is based on the co-authorship network of Filipino computer scientists 
created by Pabico [21] with |V| = 605. Notice that there exist some pronounced 
vertex clusterings in each connected component. 

search a given graph of vertices that has a path from vq. First, BFS lists all vertices that 
are adjacent to Vq. Then, it starts again with another vertex Vj in the list that is directly 
connected with the previous vertex. The usual convention is to take the first vertex in the 
list as the v t . BFS again does the listing of vertices that are directly connected to v t . The 
algorithm stops when there are no more vertices that have a path from Vq. Now, if there 
still exist vertices that are not listed after the BFS has been done, then the said graph is 
considered disconnected. The complexity of a BFS algorithm that returns all connected 
components is 0(|V| x |£|). 

In DFS, the traversal is done in a depth-first fashion, wherein the outcome is a forest of depth- 
first trees. Each tree in the forest contains vertices that belong to a different subgraph. The 
correctness of DFS as a test for graph connectivity follows directly from the definition of a 
spanning tree, and from the fact that the graph is undirected. This means that a depth-first 
tree is also a spanning tree of a graph induced by the set of vertices in the depth-first tree. 
Assuming that the graph is stored using a sparse representation, the run time of the DFS 
is0(|£|). 

3.4. MCL 

The MCL starts from a random starting vertex Vo G Q and walks to other vertices connected 
to vq. Here, Q maybe described using a similarity matrix. The traversal usually does not 
leave the graph’s cluster until many of the cluster’s vertices have been visited. The idea of 
the algorithm is that it simulates “flow” within a graph. The flow is done iteratively wherein 
after each step, MCL demotes the edges within the distant nodes and promotes the edges 
of the nearby nodes. To do this, MCL takes the corresponding n x n adjacency matrix A 
of the graph Q and normalizes each column to obtain a stochastic matrix A4 . This includes 
adding the diagonal elements in the adjacency matrix to include self-loops for all nodes. 
After initializing the matrix, the algorithm uses two alternating functions: (1) expansion, 
which is used to flatten the stochastic distributions in the columns and causes the edges 
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and paths of the random walker to become evenly spread; and (2) inflation, which contracts 
them to favor paths. It is said that the MCL algorithm’s complexity is 0(n 3 ), where n = |V| 
is the number of vertices of the input graph. This is the same as the cost of multiplying 
two matrices of dimension n. It is also noted that the inflation step of the algorithm has a 
complexity of 0(n 2 ). The mathematical analysis on the time complexity of MCL is discussed 


in detail by van Dongen 13 


3.5. Kamada-Kawai 

The KK algorithm [3j is commonly described as a “spring-embedder” where the vertices 
Vi,V2 ,---,v n G V are considered particles that are mutually connected by springs in a 
dynamic system. Each vertex G V is initially located within the canvass with its two- 
dimensional coordinates (aq,?/j). The human-readable layout of vertices in the canvass is 
directly related to the dynamic balance of the energy E in the spring system. In other 
words, E is modeled as a system of springs with a degree of elasticity wherein a desired 
resting length is achieved when the system reaches an equilibrium. This physical fact is 
described mathematically in Equation [1] The best layout for a given graph Q is at min¬ 
imum E. 


E 

L 


^ 71—1 71 

- X] X/ (-^m ~ L x dij ) 

z i= i j=i+ 1 

Lo 

m.ct dij 
K 


(1) 

( 2 ) 
( 3 ) 


In Equation Q] = yj(xi — Xj ) 2 + (yi — yj ) 2 is the Euclidean distance between vertices Vi 
and Vj while d tJ is the graph theoretic shortest path [Xj]- L is the desired length of the 
canvass edge. However, when the size of the canvass edge is already constrained, say as 
Z/ 0 , L now (Equation [2D depends on the graph theoretic diameter (25|, which is the distance 
between the farthest pair of vertices in a graph. The coefficient Ay,- (Equation [3D quantifies 
the strength of the spring that connects v % and Vj. In Equation [3] K is a constant. 


Given an initial location for each vertex, KK firstly calculates the “energy” or the sum 
of spring tension for each vertex. The initial vertex location is usually randomly assigned 
within the canvass. Some implementations of KK randomly initialize the vertices along the 
diameter of a circle. Whichever vertex initialization procedure is used, KK first finds the 
vertex v* with the highest energy. It then uses a modified Newton-Raphson procedure 26 


to compute the new positions of v* until the energy in the graph is minimum, or below a 
certain threshold e. The necessary condition to find the minimum is, 


dE 

dx m 


dE 

dym 


0, VI < m < | V|. 
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The above condition can be calculated by taking the derivatives of Equation Q] with respect 
to x m and ym- 
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After this, KK looks again for the vertex with the next highest energy and begins moving it. 
When all vertices have been moved, KK stops and the graph drawing is done. The complexity 
of the original KK algorithm is 0(|V| 3 ) which is just equivalent to finding the distances of 
all pairs of vertices in Q (i.e., the simple shortest-path algorithm of Floyd). After that, KK 
requires 0(|V| 2 ) to compute the Newton-Raphson iteration for all high-energy vertices. The 
reader is directed to the work of Kamada and Kawai [3] for a thorough complexity analysis 
of KK. 

Because of the ease of using the KK algorithm for drawing graphs, several modifications 
have been made to it. One of them is the modification for input graphs with non-uniformed 
vertex sizes. This modification uses an iterative KK (IKK) where a layout for a graph with 
arbitrarily sized-vertices is found by iteratively finding a nice layout of a similar graph with 


weighted edges and dimensionless vertices 27 


3.6. Drawing constraints 

The literature is not lacking on methodologies that allow one to visualize graph structures. 



as straight lines, polygonal lines, or curves. In our drawings, we did not put a constraint on 
the location of the vertices, while we have drawn the edges as straight lines. The main task 
of our algorithm, is therefore, to find a location for the vertices of a given graph such that 
the number of edge crossings is minimized, and at the same time, uniformly distribute the 
vertices and the edges within the canvass for easier readability by humans. 


4. Hybrid drawing 

We discuss the procedure for our HGDA using the graph shown in Figure [21 as an illustrative 
example. The procedure is as follows: 

1. On an input &(V, £), run DFS to output n subgraphs {Gi(Ki, E\), 02(14, E 2 ), ..., G n (V n , E n )}. 
Here, V = V\ U V 2 U ■ ■ • U V n , £ = E\ U E 2 U • • ■ U E ni and n < \V\. As discussed above, 
this step has a complexity of 9(\£\). 
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2. For each sub-graph Gi, run MCL to find the clusters in each G t , Vi = 1, 2,..., n. The 

output of the ith MCL is m clusters {C^i, • • •, Each cluster C t ,j has an 

associated set of vertices Vij. Here, Vi = i U v ^2 U • • • U and m < \Vi\. This step 
has a complexity of 0(n x (max™ =1 (|F)|)) 3 ). 

3. For each cluster C U j, run KK to rearrange the vertices in v ij3 . This step has a time 
complexity of 0(m x n x (max(|ui i i|,..., |u miri |)) 3 ). 

4. Consider each cluster Cij as one big “phantom vertex” for a temporary subgraph G\. 
If there is at least one edge going from one vertex in the current cluster Cjj to another 
vertex in another cluster C,^, create a “phantom edge” connecting C h] and G^. The 
complexity of this step is 0(n x m) to connect the m phantom vertices with m — 
1 phantom edges. 

5. Run IKK on G' to rearrange the clusters within the sub-graph Gi. It should be noted 
that because clusters are now considered as a vertex for the sub-graph G*, the phantom 
vertex has already gained its own size. Because of this, IKK is useful because of its 
power in drawing nice layouts for graphs with vertices that have different sizes. The 
complexity of this step is Oinxm 3 ) because there are only n subgraphs with m phantom 
vertices each. 

6. Consider each Gi as one phantom vertex for a temporary graph G*. Since all subgraphs 
are disconnected from each other, make each G* be connected to at most 2 other 
phantom vertices only and no two phantom vertices have at least one same vertex 
connected into it to avoid creating a cyclic graph. As in step [2 the complexity of this 
step is 0{n ) to connect the n phantom vertices with n — 1 phantom edges. 

7. Run IKK on G* to rearrange the sub-graphs. Again, using IKK is useful here because 
sub-graphs, which are now considered as phantom vertices, will be of different sizes and 
has dimensions. The complexity of this step is 0{n 3 ) because there are only n phantom 
vertices corresponding to n subgraphs. 

4.1. Fully-connected graphs as input 

On an input of a fully-connected graph Q(V,£), HGDA will have a complexity of 6{ |V| x 
(|V| — l)/2) = 0(|V| 2 ) in step one. Step two, however, will have 0(|V| 3 ) since there is 
only one subgraph and the lone subgraph has |V| vertices. Since Q is fully connected, only 
one cluster will be created from MCL and thus step three will have a time complexity of 
0(|V| 3 ). Each remaining steps will only run in 0(1) because the number of clusters found is 
one, while the number of subgraphs created is also one. Thus, for a fully-connected Q as an 
input, HGDA will run in 0(|V| 2 + 0(|V| 3 ) + 0(|V| 3 ) + 0(1) + 0(1) = 0(|V| 3 ). 

4.2. Graphs with 8 = 0 as input 

On an input of a graph Q(V, 0) with no edge, this means that there are |V| sub-graphs, each 
with only one vertex. Step one will have a zero time complexity. However, step two is exactly 



Figure 2: An example graph Q with two unconnected subgraphs G\ and G 2 (colored in the 
digital format of this paper). The red circles identify the two subgraphs G\ and 
G 2 found by the first step. The blue circles identify the four clusters Cyi, C\ t 2 , dug 
and C' 2,1 found by the second step. There are three clusters in G\ and only one in 
G 2 . The nodes in each cluster were drawn in step 3. Clusters Cyi, Cy 2 and 
were considered as “phantom vertices” and were arranged using IKK in steps 4 
and 5. Subgraphs G 1 and G 2 were considered as “phantom vertices” and were 
arranged using IKK in steps 6 and 7. 

0(|V|), while step three is 0(1). Steps five and seven will run 0(|V|) and 0(|V| 3 ), respectively. 
Thus, for an input of G{V, 0), HGDA will run in 6*(|V|) + 0(1) + 0(|V|) + 0(|V| 3 ) = 0(|V| 3 ). 

5. Parallel Implementation 

Our proposed HGDA needs to be run on parallel processors in order to efficiently draw large, 
naturally-clustered, disconnected graphs. In this section, we present our implementation of 
the HGDA over a parallel random access machine (PRAM) architecture and derive the cor¬ 
responding parallel complexities per step. We assume here that our PRAM has p processing 
units (PUs) that can compute in parallel. 


5.1. Parallel DFS 

The search for connected components of the input graph Q can be parallelized by partitioning 
the adjacency matrix A into p parts and then assigning each part to one of p PUs. Each 
PU Vi has an associated subgraph Gi of G, where Gj(V, E)) and E t are the set of edges that 
correspond to the portion of A assigned to V % . We implement the following steps: 

1. Each V L computes the depth-first spanning forest of Gi to construct p spanning forests; 
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2. We merge the spanning forests pairwise until only one spanning forest remains. 


The remaining spanning forest has the property that two vertices u and v are in the same 
connected component if they are in the same tree. Step [1] above can be computed sequentially 


by using any of the Kruskal |[30j|, Prim 31J, or Sollin |32| algorithms. However, a parallel 


algorithm exists that uses p = |V| 2 on a concurrent-read, exclusive-write PRAM to solve 
the problem in time ©(log 2 |V|) j33j. To implement step [2] above efficiently, our parallel 
implementation uses disjoint sets of edges. Assume that each tree tij in the spanning forest T % 
of a subgraph G{ of Q is represented by a set. The sets for different trees are pairwise disjoint. 
We defined the following functions to be applied on the disjoint sets: 

find(x) : This function returns a pointer to the representative element of the set containing x, 
where each set has its own unique representative. 

union(x, y ): This function unites the sets containing the elements x and y. The two sets 
are disjoint prior to the operation. 


Let Tj and Tj be the two spanning forests to be merged. We merge the spanning forest as 
follows. At most |V| — 1 edges of one forest are merged with the edges of another forest. 
For each edge (u,v) E Tj, a find operation is performed for each vertex to determine if the 
two vertices are already in the same tree of Tj. If not, then the two trees of Tj containing u 
and v are united by the union function. We can see here that merging Tj and Tj requires 
at most 2(|V| — 1) find calls and (|V| — 1) union calls. Thus, the cost of merging is 0(|V|). 
The parallel DFS has a parallel complexity of 0((log 2 |V|) because it is dominated by stepQ] 
above. 


5.2. Parallel MCL 

Since MCL is based on the simulation of stochastic “current” flow in graphs, an analytical 
method can not be performed for implementing the parallel MCL over PRAM. However, 
several implementations, such as those by Olman et al. [34j and Bustamam et al. j35j, have 
been performed over a message-passing architecture wherein the respective runtimes were 
experimentally determined. 


6. Conclusion 

We developed a hybrid graph drawing algorithm by incorporating in series: 

1. the DFS to find the n connected components Gi (Vf = 1,..., n) of an input graph Q, 

2. the MCL to find the m clusters of vertices in each connected component, 

3. the KK to layout the vertices in jth cluster, 

4. the IKK to layout the clusters as phantom vertices, and 

5. another IKK to layout the components as another phantom vertices. 
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We derived the runtime complexity of our hybrid algorithm by considering input graphs in 
extreme cases: a fully connected graph Q(V,£) and a graph with no edge Q(V, 0 ). With 
these input graphs, we found out that HGDA has 0(|V| 3 ) runtime complexity, where V is 
the set of vertices of the input graph Q. Although we found that the runtime of HGDA is 
slower than that of the KK or IKK, our purpose here is not to improve the runtime of the 
drawing algorithm, but instead to “nicely” draw large, naturally-clustered, and disconnected 
graphs that usually model the complex inter-relationships among entities in social, biological, 
natural, and artificial networks. We designed an implementation of parallel DFS over a 
PRAM and found its parallel runtime to be ©(log 2 |V|) if p = |V| 2 . 
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